home *** CD-ROM | disk | FTP | other *** search
/ Celestin Apprentice 2 / Apprentice-Release2.iso / Tools / Languages / Icon 8.1 / msm-2 / iconc.sit / tokens.txt < prev    next >
Encoding:
Text File  |  1992-09-19  |  2.6 KB  |  78 lines  |  [TEXT/MPS ]
  1. Primitive Tokens
  2.  
  3.    Token                Token Type      Flags
  4.  
  5.    identifier           IDENT            b e
  6.    integer-literal      INTLIT           b e
  7.    real-literal         REALLIT          b e
  8.    string-literal       STRINGLIT        b e
  9.    cset-literal         CSETLIT          b e
  10.    end-of-file          EOFX
  11.  
  12. Reserved Words
  13.  
  14.    Token                Token Type      Flags
  15.  
  16.    break                BREAK            b e
  17.    by                   BY
  18.    case                 CASE             b
  19.    create               CREATE           b
  20.    default              DEFAULT          b
  21.    do                   DO
  22.    dynamic              DYNAMIC          b
  23.    else                 ELSE
  24.    end                  END              b
  25.    every                EVERY            b
  26.    fail                 FAIL             b e
  27.    global               GLOBAL
  28.    if                   IF               b
  29.    initial              INITIAL          b
  30.    invocable            INVOCABLE
  31.    link                 LINK
  32.    local                LOCAL            b
  33.    next                 NEXT             b e
  34.    not                  NOT              b
  35.    of                   OF
  36.    procedure            PROCEDURE
  37.    record               RECORD
  38.    repeat               REPEAT           b
  39.    return               RETURN           b e
  40.    static               STATIC           b
  41.    suspend              SUSPEND          b e
  42.    then                 THEN
  43.    to                   TO
  44.    until                UNTIL            b
  45.    while                WHILE            b
  46.  
  47. ``Operator'' tokens not used in standard unary/binary syntax, see op.txt.
  48.  
  49.    Token                Token Type      Flags
  50.  
  51.    (                    LPAREN           b
  52.    )                    RPAREN             e
  53.    +:                   PCOLON
  54.    ,                    COMMA
  55.    -:                   MCOLON
  56.    :                    COLON
  57.    ;                    SEMICOL
  58.    [                    LBRACK           b
  59.    ]                    RBRACK             e
  60.    {                    LBRACE           b
  61.    }                    RBRACE             e
  62.  
  63. tokens starting with $ are alternate spellings for some tokens
  64.  
  65.    $(                   LBRACE           b
  66.    $)                   RBRACE           e
  67.    $<                   LBRACK           b
  68.    $>                   RBRACK           e
  69.  
  70. Explanation of Flags
  71.  
  72.    b    indicates that the token may begin an expression.
  73.    e    indicates that the token may end an expression.
  74.  
  75.    These two flags are used for semicolon insertion.  If a line
  76.    ends with an "e" token, and the next token is a "b" token,
  77.    a semicolon is inserted between the two tokens.
  78.